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^tish evaluative studies in education have taken diffes^t^ 
appn>aches frons those in Xmenca. Although there has been some 
interchange of ideas, the social context ia rhe rvo countries 
is different, requiring different mechanisms for the initiation, 
inipleoenration and follov-up of educational evaluation* 

There are still lessons ^o be learned in thi's relatively nev ^ 
field from conrparing wortc in the tvo coxintries, using exAnrples 
from recent studies • ^ 

This paper exaaines and compares British and American approaches, 
unde/four headings: 1) their political genesis 2) agencies 
involved m -coinniissioning arid executing evaluative studies 3) use 
cade of results 4) possible- evolution of these approaches* 



in 



eraluati%"e ytadies io edasatioa 



David G. HsvJcridje 
l^ie British Dpea Uaiversity 

Introduction / 

Notod>- could be bl&aed, for tiunkirig tiiat the title of this p&per 
specificAlly desi^.€<5 to be e^-e-catching ic 3i cerrt esru &1 Tear. Tbe new 
that the author wa^s rot a caLadidate in tbe elections for a ne^ British 
Prxme Minister exid that be :ioes not int^end to eater the Presidential rtce 
%ali do little to neassnre those who feel the Bo^ceorenair?' is being nia.de tbe 
excLxse for eve r>t.hi no « 

< 

Indeed, isolationists vill point out that America is independent nov, end / 
there is no need for a Britisher to come hot-foot to San Francisco to try 
to sell roaskets and viuske^- to the colonials. Mai^ts, thej- vili sajy^e 
ha-re enough of, hoae-oiade , and v^hiskey ve buy froa tbe Scotch, viio as^ 
scarcely British anyvay. y 

Vhy, then, ^d A231A accept this paper? in general renns, it is ^ fact that 
after 200 y*r? there are differences betveen Britain and Amerida, not 
least in their respective educational systems^ tore specifically, approaches 
to evaluative studies in education in rhe tvo coantries have evol%'ed qtiite 
differently. This paper seeks to identify many of these differences, vfaich 
have corae about' because the social context in the tvo couiltries is different, 
requiring differing mechanisms for the initiation, implementation and follow- 
up of educational evaluation. It is true that there ixts been some interchange 
of Ideas between educational evaluators on each side ^ the Atlantic, but the 
differences seeo worth reporting and discussing. 

No doubt readers of this paper will see it fromn^re than one angle* Some 
may gain new insights iniJo their own local sitturtion. Some may be stimulated 
to attempt to apply techniques used elsewhere. Others may feel that -what is 
right for Britain is wrong for America, and Vice versa. On the other hand, 
it is possible that approaches used bhe side of the Atlantic may have 
sufficient intrinsic merit to be included J n evaluative studies tbe other 
side. 

f/ 

The British and American approaches vUl be compared under four headings = 

1) fheir political genesis: The l^ritish low-key approach to educational 

•evaluation is largely divorced ff^o political influence, %^le American 

legislatures insist on evaluatioh in public education. This has been so for 

the past decade. The paper wlfl discuss the differences, identifying them 

within their social and economic contexts.* ^ - * 



liavid Bawkridge directed a series of national evaluation studio of cospensatory 
Q education while at the American Institutes for Research 1967-70. Since then he 
ERIC ^ Director of the Ir^titute for Educational Technol6gy At the Open 

HanMffl University, with a major role In the evaluation of that University's activities* 



AMfough bc^th Brat&in sj-id America bfeve putlic e^uoatic^n s^-st^cs at ele©enXAry, 
^*<;c*ndar->' s.nd t^-r-tiar^ l^v^rTs^ the two count ne*5 t^aw very diffef^-nt agencies 
for tl:^ connri ss 2 o^^irffj of *n*alaaiir«- studies at tbe b€^>e'St of political 
foarces, arid for «€-cjtiag thnt studies. CoriSeq;>entl3?^ different patt^^ros of 
forces ai>^-*B^t up between €'Traluat.ors, tbe evaluated and the dienrs. 
Accoiartabil It? is a concept ^fiic^t differs iDjx>^er and connotation in the two 
coc^t nes. /he nature of e^»'alaative sttJdies is strongly influenced, needless 
^Xo sa>, by the connci srs i oru ng a^nd execajting aigencies. There are major 
differences m evaliiat^ive 'styles', s-ome of vtiici can be traced bac^ t^o 
differem philosophical arid ethical standpoints. ^ 

3) The tis^ made of results; . Just as there are differences in tite v^^rs 
evaluative studies ongir^ate and proceed in Sritaan and America there are 
also differences m the expected arjd actual use inade of results. In both 
count riesv^ the results of eraiuati%*e studies are frequently dismissed b>' 
those to v^iott the> are unfavourable* That is sni5>ly human nature. There are 
di^i-erences, however, in the exp>ectations of agencies and of the evaluated, 
rod these can be explained at least partially by an anal>-sis of the context 
of the steadies. 

4) Possible evolution of these apjproacbes; Powerful politicad and economic 
forces are likely t!o bring about chaiTiges in the approaciies employed in 
educational evcrluation in both countries. In Brit^fi» persistent ets^nomic 
crisis yeems likely to reduce funds for, evaluation, in spite of calls for 
greater cost-effectiv^ess. In America, political problems arising from 
trenchant minority groups, coupled with some disiliusionm^t wi^Jh scientism 
?among middle-class people, may lead t^g reader use of illuminative approaciies 
to evaitiation. If xhere is a decline in belief in capita^lisn and consumerism, 
there may also come a change in stress, from summative to formative evaluation 
All of this, of course, is in the realtxi of speculation, and is not based on 
systematic 'futures' research. 

Vhat conclusions and recommendations are there with which to end the paper? 
None, since it is essentially contemplative. Ko experimental results are 
being reported, no hypotheses are being tested, and -there will be no 
recoim»endations for further research. Instead, the questions raised by the 
o om paoson may stimulate some worthwhile discussion. 



Definitions and examples 

Few people will quarrel -with Popham*s (1975^ statement that the generally 
accepted definition of evaluation is *'a determination of value**. Evaluation 
is clearly the business of judging value, by whatever means at our disposal. 
Pretentiously, ,the word can be applied when judgements are being made about 
electric razors* or tennis balls, although significantly in these cases it is 
commoner to spea)^ of quality control* More generally, evaluation xs a term 
used when judgements are being made about policies and people. 

As Popham points out, educational evaluation as a process is not new, if we 
include mpder that term all the determinations of value that have taken place 
within education for centuries, ^hat interests bio is systematic evaluation 
in education, a formal (institutionalised?) kind, which he calls genuine. 
Irideed, the title of this paper may come close to satisfying Ppphaa. 
'Evaluative studies in education' attempt to determine the value of something 



educatix»aai by st-udying it, usually syFTeniatically, if not scientifically. 



Sucii t^ncs as educational ennaluatioa and evaluative st^odies in edticaiion are 
really too all-ii^usive, bovever, even vitJb the Po pb an; provisos rcrgarding 
fomality and sj-steo. Judgements of value are beiag ja£rf5e every day m 
co:£ntless educational esrabl rsbnients, often m a formal a nd sys temsric 
fashion, vitbout anyone calling that activity educap^c?i2aT"^«raati>rs» 
Edncational research and development is fall of determrnations of vaioe, yet 
many of tbe professionals ^gaged in this ifieLtJ wojald nbt thir^ of theais^lves 
as educational evaluatoi-s. What, then, are we talking aiout? Bovr can ve 
justifiably narrow doioj the definitifcrn to asccep^jabie limt^, at least for the 
-parpose^ of this paper? 

First, laJce P^iftiam^ we can throv oat determinations of the educational standing 
of indi vidua! s-/%*tiich fee lat»els educay^nal oeasuretDent or stat-us deten^nation 

Second, if ve like we can also eiiitmate all s^jdies that are private. The 
number is not great. »e can say y^e are interested m educational evaluation 
that is public. LajTDert and meiribe rs of the general body politic should have ^ 
access to' suc±i str^idi es . 

ITurd, and suailarly, we can restrict our discussion to the evaluation of ^ 
public .education, %i'hether at the national, regional or local level. In both 
Britain and Ainenca, veil o%'er 90^ of education d«>ends upon the public parse. 

^e tcay not throw out^studies which do not explicitly set out to evaiuatej but 
do so. There are educators and researchers wto claim that they ^te doing no 
more than present the facts, leavxtsg the interpretation, determination ajid 
judgement to others. These people ignore the judgements they icake in 
selecting the ways they so about collecting, anal3rsing a n d summarising data. 

Nor may we throw out studies wrhich are not addressed to the *true' cli€=ntele, 
the students. The improvement of education is the general goal, set for the 
benefit of society at large and th^ students of a generation in particular. 
Ve must include evaluative studies that contribute to the reaching of that 
goal, even %i'hen they are addressed to State officials, or the C^een on b^ialf 
of her government. 

Within our range mast t^e studies that differ radically in their methods. Ve 
may go. as far as including the evidence-col lect>ng of a Senate Contni ttee as 
well aLs the detailed quantitative analysis probably re<|uired in evaluative 
study of a new computer -assisted way of learning celestial navigation in the 
Air Force. Scnven (196?) and others sinee have indicated the diversity of 
methods that may be employed. 

In the end, «-e shall probably discover that most oC the studies ve have in 
mind share one characteristic: they^ enrich the d^^iiate o« matters oS 
educational policy^ Eval ua tors ^fcay intend that their studies should actually 
svay the debate fii^aly in one direction or another." For. example, HcDaniels 
(1975) writing about-- -Fol low -Through evaluation, says 'And, at last, ve may 
soon be able to demonstrate that compensatory education works' • Tiiae and 
time again, however, evaluators observe that politicians and officials, 
•educators and students use their reports in unexpected ways to suit partiaA^r 
p^irpos^^ ,The role of government and the people in bringing about cHajgge 
cannot be ^ignored by^ educatiorial evaluators or anyone else. 

/ 



£»d**quaT*'2 V d^fme^i b> zh*- adif-rtivc-s that an?- att^^icii^ t-o zts^ tenc: formid 
institut2c^rva]iS-*<2* systero3t2C% not -«^-p*-C2 fi c-ro-msii V2 duid s* &nd so on. It 
2S very terpptanp s-e^ funh^r clarification by probing zhe pinlosoj^acad 
pctsitic^i of parti-cular e^JcatioMl waduators. Are they ratior^al object! visrs. 
for «C£4cple' Thit is to s^ay, 4o ti:ey t-uke the vieu tHat education car< be 
iirproved through Hara s rcitior^al be^a^'iour, throu^ ob.iectiv*^' st^udy of wfcat is 
going on^ Or are th^? creative hiimanisrs, wc*tc±u rtg for the artistic leap 
apparently urLrel a tea z.o values held or icriovledge gained? Are tfee>- reformers 
at heart, alv.>ays hoping that s-oiuething better car^ oon»e froic their evaluative 
acti-vities? Or is there a battle ^nong e^iucatioaal e%-aluators 'and their 
cli'^nfi^ b^^tv^eer the forces of scientisn; and thos^ of mtuitioa iHsvkridge, 

*1970;^ 

s 

iTi fact, educational evalt^ators, corxsciously or othervise, take up laany 
philosophical positions anc adopt marn* roles 'Hawkndge, iTiT^a*, Lat-er ve 
shall rxote soiDe r*ational oifferences, but this is liot the oc4^asion to explore 
the v'l'de rar^ge of positions aj»d roles see also rdamilton et al , , m -^^r^BS^. 

There is one further >cay open to us m atteicpting to define the set: by 
givir*g examples, lo be precise, ve vould have to provide exaaipi,es that just 
c^Be VI thin the set ar/d oppose them vith others that just feel ontside the 
&et« That too is a loore ext^ensive exercise than can be t^c^ed in thi-s 
particular p&per, therefore Table i srnrply provides a f€*r Brirish and American 
exairples, belongirjrg to the last ten years; many will be familiar ts? A2PA 
members • 



Table 1 Some examples of British and American ei'aluative studies 
m education. 



Britxsh 

The Halsey Report on the education of cultorally-disadvantaged, chi Idren 
The Russell Report on adult education 
The Bullock Report on children's reeding 
. The James Report on teacher education 
Evaluative. studies of ^Schools Xk>uncil curriculum projects (see Table 4) 
Evaluative studies of ,Jwuf field Foundation curriculum pro^^ts 
UNCAL: Evaluation of the National Development Programme in Computer- 

, Assisted beaming 
The Open University's program of pel f -evaluation 



American 



ERIC 



I J \T\im' I iT Seco.*aary Education Act Title 1 Evaluation 

Head SjiliT Evaluation ^ • 

Follow Through Evaluation 

-The Coleman Report on educational opportunity 
Tjxiian iiducation Act Evaluation 

Upvard Bound £val;uation x 

Teacher Corps Evaluation 

Experi«^tal Schools Project Evaluation 

B 
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3esides attempting vo define educational e%'aiuarion, we need soxoe definitions 
of the Atoencaxi end Bntisb education s^-st^sms* AaericaJi educatxoGf^'^^le 
certAinlT Tiot bomo^er^xis, does at le&sx h&ve a relatively siirple tiyp^^lek^el 
stnjrturi of government ^Federal, State and Local K Britain ftbat is to say, 
tbe United Kinpdoiu of Great Bntain and Kortbem IreiandMias a i3>±>nd 
governmental structure for its ^cation* Jibfthem Ireland ve cannot speak 
of kno^ng that v-hat ve say v^ill still be true tonorrpv, because ci^anges there 
have followed swiftly upon one arjotiTer in r-ecent years, but at preseait its 
• ied^ucationai system Is controlled froixi London. Scotland has its own Scottish 
EHuqation J>epartment, under the ^«retar>' of State for Scotland, a Cabinet 
Minister at Westminster y^izh responsibility for other portfolios as well as 
e:3ucation. But this person is not responsible- for the Scottish universities^ 
vtuctk are under the Oepartcent of bducation and Science in London, along vith 
pri-mary, secondary and tertiary education in both r>>gland axrd Wales. Kaking 
generalisations about British education is therefore e^-en more dangerous than 
doing so ab>jt An>eriC5Li: education. 

When Amencarj education sviict-/ed recently froic using the tern 'School 
Districts* to the tern 'Local Education Agencies', this introduced a further 
-^potential source of confusion, because in Britain there are Local Education 
Authorities, abbre^-iated to L^As, just like the American agencies. There are 
tvo iirportant differences, however, and these should be noted. First, the 
average British LEA is a larger unit than its American counterpart. For 
exairple, there are only 1^5 LEAs m England. Second, the British L£A is tied 
closely to the so-called local iOounty Council) government, -tahich is closer 
to being regional in Americ^an tenns. Coiinty Councils are controlled by one 
political party or another, and they can be conspared vitb State legislatures. 
Table 2 atteirpts to clarify the position. 



Table 2 Levels of government and admiriist ration in British and 
^ American education. ' 



Level 


British 


American 


National 


Parliament* 

ar^partment of Education & 
'Science (England, Vales & 
N. Ireland) 

Scottish Education Depart- 
ment 


Congress* 

Department of Health, 
Education & Velfare 


Regional 


County councils* « 

Local Education 
Authorities 


State legislatures* 

State education departments 


Local 


School governors* 
Individual schools 

A 


Boards'^of Education* 

Local Education Agencies 
(LEAs) 

1 . 



• Elected 

ERIC • 



, or at' least politically influenced. 




The political oer^esis of Bntigb asa^ AroencaTj €^*aluatiye studies 

Politicians, to s^y nothing of civil servers, fall into tv.*o ^rT>:jps: those 
wte consciousl> consider e^cational e-^^al nation and those *^ho do not, 
MeB±>ers of both groups ^^11 be found in Vashxngton as veil as London, but 
certainly there are core of the latter rn London. Sunilarly, politicians 
fall into^vo caxrps over the value of e^'aluation in education. There ^^re 
those vrbo say cannot afford it: the decisions ^:ill be taken am-vay and 
in the light of niany factors outside the scope of educational evaluation* 
Opposing thena are those v'ho say ve cannot afford not to have educatiorial 
evaluation es wtiiout it wrong and costly decisions wall be taken, affect 
the lives of thousands of students. 

In Britain at tfee r^atior^l^ level , the politicians are largely igrionarft abwt 
fontal e±ucatior^l evaluation* in spite of the fact that education"is a^higHly 
political aresva. : They would rjot firrd this a startling allegation: they have 
their priorities, arid educatior*ai ei^aluation as such is r^ot anong these. 
Educational evaluation does not feature as such in any piece of current 
British l€rgislation, so far as this author has been able to dishas^er^ It does 
riot 'merit a separate line in the national educational budget authorised by 
ParliatDent, nor is it built into educational policy. It has not been the 
topic of an educational debate in either the Bouse of Commons or the House- of 
Lords during the past six years. 

The major reason Jor this apparent lack of interest 'possibly lies in the fact 
that ID the short-tera (3^5 years ahead, let us say) nearljc all educational 
expenditure is predetermined m Britain, ar^ the maVgin fo? cSiange of any kind 
is very small indeed ^Fovler, 1974 )• In other words, policy- change is 
drastically limited by shortage of cash over and above what is required to 
keep the system going. 

Reviews of policy- do occur, hovfewer, ar*d changes in British education over the 
pjast t^^enty years. have been quite remaritable considering how small this fiscal 
margin is said to be (see Kogan and Packwood, 1974). The rew'iews take place 
mainly within the Department of Education and Science -and the Scottish 
Dopartmeant of Education. In these departments there is greater awareness and 
knowledge of educational ^^-aluation than in Parliament, but in the broad sense 
of making judgements of value, without studies being undertaken of existing 
progrsims. A recent policy review, leading to the 1972 Vhite Paper entitled 
Education r a framew^r^ for ^pansion , was nftt based upon extensive educational 
evaluation of the American kind, but its led to the establishment of new 
jSriorities by Parliament. XHe implementation of these new priorities began 
shortly afterwards, but a^in it w-as not accompanied by massive, formal 
educational evaluation. Instead, Fowler (1974) tells us that the'progress in 
achieving the impiementation of the new priorities was to be 'consjtantly 
monitored*. (Fowler should know: he was a Labour Cabinet Minister up -to 1970, 
and becape one again in 1974 Mehen Labour returned to power. He is at present 
^Minister of State for Education and Science.) 

It would be wrong to think that this constant monitoring consists s^elj of 
-bureaucratic teaperature-tAking in the political waters. Vhiie it*is true 
that« the two Departments h&ve a good infornatigj^ network (the Department of 
Education and Science has 500 inspectors spread throughout the territory it 
covers, for example)) t^ere are other ways of xDonitoring progress, esxmg 
which is s<x3e* educational evaluation, hjiat is clear, however, is that core 
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often than "not the chain of influence is tenuous bet%»een the political 
tMLBters and the educational evaluators. The latter are fev in number and 
s>nly inoirectly fesponsive to political pressures from Vestnirtster. 

By contrast. Congress takes <s core intiisate interest in educational evaluation. 
HR 69, passed by the VS Bouse of Representatives on March 28, 19?f4, directed 
the yCational Institute of Education to carr>- out a thorough evaluation of 
coitpensatoo' education prograims. This- by no means the first prece of ^ 
legislation to carr> such a message. Robert Kennedy's ajnendioent to the 1965 
>£1 eniem^&r>' and Secondary Education Act called for similar actfon, and made 
evaVda<ion a condition for th^ money being granted. The fact that for some 
ye^ra i^rtiaps to this da> ; a large number of programs ^ere implemented without 
veil -desig'ned evaluation is neither here nor there: the political vrill to 
^'aluate education^^rograms *»as expressed years ago in America. Every major 
c-hange in Federal . ipBcat ion policy an the past decade has been accompanied by 
leaisiation ^••hich included clauses requiring evaluation aod making financial 
provision for the wo'rk to be don^- ^ see McLai^hlm, 1975i ^^or a history of 
Titie p. ' • / 

v4iy did this happen m America, yet not in Britain? Economic conditions 
favoured a p>articuiar course of action. Clark (1976) claims that the Federal 
investment in educational research and development (including educa^tionaX- 
evaluation) is now approaching $200 millions. This sum is over and above the 
funds provided by state find local sources for the regular provision of 
edxication, plus the massive funds offered by the Federal Government to sugp rt 
special^ services • The allocation of such *large suras was possible during ot& 
times of boom in the late sixties^ Kot only could Congress afford to set up 
new interventionist programs^ it CQuld also afford to have them evaluated* 
Some Congressmen wanted to have thei^^valu^t-ed because of a basic belief in 
the ineffectiveness of such edupatii^nal expenditure; others felt that the 
•best defence ^against the former group would be found in evaluation data. 
These* political forces are still to be seen in Congress tpday. 

The regional level reveals a similar pjattem of comparison. State legislatures 
have enacted laws requiring evaluation to be bqilt into educational programs.* 
In Britain, the Cotinty Councils have not show-n interest in educational ^ 
evaluation as such, although there have been many fierce pplitical battles in 
them over educational p>olicy, such as the move from the tripartite system 
(grammar, modem and technical) of secortdary schooling to the new comprehensi ves* 
In these' battles few counci 1 lors .i f any have proposed that there should be 
formal evaluation of the new schools and their xmrricula. 

* * « 

At the local level many AmerFcan school* "-district^ live with accountability. 
As Stake (1973) says, accountability means keeping good records and making * 
actions open-to-view, strictly speaking'. Control. of the schools by local 
communities has worked well in America, he thinks, and the new State 
accountability and evaluation legislation may have adverse affects at local 
level' (see also Murphy and Cohen, 1974). Yet loca| political forces in 
America tend to support rather than work against accountability. School boards 
are elected, and school superintendents are appointed cm ^hort-terra contract 
m many cases. Discontent among parents can rapidl.y lead tb recall electitjns. 
Evaluation becomes desirable under these ci rcumstamces , from the poi%it of vie*^ 
of the elected, who wish to defend tHf»i r policy choices, and from the point of 
view of the electors, wfio seek evidence that their money is being well spont^ 
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• For exa^iple, CsLliiamiei Senate Bill 28 >(the Unruh Dill) set up a special 
Y/^" fund to support reading programs for the disadvantog(»d, and required the 

evaluatfion of these programs • Jj 
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hi Britain foraal f=*valuation siaply does not exist at the local level. Local 
mtcMioroy rests very much in the hands of the principal of each school. He is" 
I*. sponsible to the County Education Officer, and has tenure', like the Officer. 
Fht 'latter, uith his staff, uork under the political control of the County 
Council, vhich usually has an Education Conmittee. rte practical balance of 
po^er between Officer and. Council varies, but the Officer is responsible for 
11%'ing executive effect to lav* and regulations as veil as carV>*ing out' county . 
policy CFowler, 197^b). The Council is not his sole political master. 

Butt U9.72) ha^ this to say about evaluation at <he local level in Britain: 

*It is a tradition of the British education systea to leave headmasters, - 
teachers and parents as much freedom as pKJSsible to determine the type 
ctnd methods of instructibn in schools^ This makes any. attempt by a 
local education authority to lay down objectives and to assess 
performance against them a potentially misleading exercise.' 

In sumtoary, the political genesis of evaluative studies in education is easily 
discovered in America: ij is in the law-making bodies, which have taken it 
upon themselves to demand educational evaluation. This genesis is much harder 
to locate in Britain, j>artly because formal educational evaluation does not 
seem to be part of the political scene. If politicians in Britain are wanting 
to see evaluative studies carried out, they are not saying so in Parliament, 
or in the County Councils, the two main politica^l fora for education. Yet 
British studies exist. Their genesis is not obviously a political one. 



The agencies commissioning and executing evaluative studies 
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The political decisions taken by the British Parliament regarding education 
are implemented through the two Departments of Education already mentioned, 
and through the County Councils. At both these levels the political bodies 
are served by powerful administrations or bureaucracies. At the national 
level, the officials carry out educational policy reviews, after ^hich raajar 
changes in policy must be put to Parliament by the Minister. Lesiser changes 
can be ordained by regulation. Sometirses these reviews take into account or 
actyally call for evaluative studies, tt is difficult to decide whether many 
of these studies are commissioned with "t^e knowledge or consent or indeed at 
the behest of politicians, as ue have inoicated, but the Departments do have 
funds for such purposes. The studies ar^ usually commissioned from academics. 
Thus Halsey (1972) undertook an important^ s^dy of problems and policies 
relating to culturally disadvantciged children ifv^Britain. More recently, the / 
Department of Education and Science fundetCTan evaluative study of a group^of 
18-20 year old students admi tted>tT>sthe OTOfWjniversity under ^ pilot scheme. 
The political genesis for such studie^^jn^, lie with the Minister, advised by* 
his civil servants. It is very unlikely that the Minister's Party5 the 
Cabinet or a coterie of members for Parli^ent would be directly involved. 



Occasionally the Department of Education pind Science provides funds to another 
bo<dy and asks that bqdy to commission evaluation. As is being reported by 
D'vJLd Jenkins it\ this session, the evalua^tion s-^udy called UNCAL is 
commissioned b> the Natiohal Development ,Krogramrae in Computer-Assisted 
Learning, which is funded b^ the De^rtm^nt through Britain's Council for 
Educational Technology (see MacDonald etjal. , 1975 )♦ 
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«f apparent lad^ of interest in the Department of Education an4 Science 
in large-scale formal educational evaluation may be related to the fact that^ 
the Department control-s^di recti y only J% of the non-university level 
"expenditure on cKiucation in England, Vales and Northern Ireland (Fowler, 
1974c). Much of the revenue for education is raised through local teoces 
(rates), but this is subsidised by central government through the Rate 
'Support Grants. To complicate matters, these grants are made for all local 
services and are passed through the Department of the Environment, not the 
Department of Education ^nd Sciencel This diffusion of power may actually 
prevent the build-up of interest in and demand for educational evaluation. 

The Central Advi^oo* Councils for Education for both England and Wales have . 
commissioned evaluative ^studies to strengthen the advice they affer to 
successive central go\ernments. For example, the Central Advisory Council 
for Education (England) has published influential reports^of vital . * 

significance. Known by the name of the current chairman of the Council, three 
of these were the Crowther Report on education for 15 to 18 year olds, the 
>'ewsom Report on non-acad,emic secondary school students, and the Plowden 
Report on primary and pre-schooi education. These were evaluative studi-es 
drawing upon a wide pool of knowledge and experience, particularly from the 
universities, and using government money for the purpose. Yet it must be said 
that there .was no formal educational evaluation in the Popham sense. The 
reports were far ojoser to the Ainerican report To Improve Leami ng than to 
tine Coleman Report on e^iucational opportunity. 

/ • ' 

There are certainly other British" institutions which operate at the national 
(or near-national, Scotland sometimes being excepted from their aegis) level 
through which educational evaluation studies can be commissioned. For example 
for the past ten years there has been the Schools Council, an organisation 
particularly interested in curriculum reform, teaching and school examinations 
in England and Wales. It is funded jointly by the Department of Education and 
Science and the LEAs and has taken over much of the work done early in the 
1960s under grants for curriculum^ development from the Nuffield Foundation. 
The Schools Council is led by professionals (its present Director is a 
university, professor) and has a good record of . commissioning . evaluation of 
its projects* These evaluative studies have been the logical concomitant of 
the curriculum projects (see, for example, Nuttall, 1971; Badcocjci^ 1972; 
Schools Council,* 1973a, 1973b; Nuttall , Backhouse and Willmott, 1974). 

There remain' to be mentioned among the commissioning agencies a fe^ trusts < 
and charitable foundations. In educational evaluation, the jnost prominent' 
of these has been the Nuffield Foundation, the smaller British equivaletit of 
ti\e Ford foundation in America. Many of the projects supported by. the 
Foundation have been subjected to evaluation, commissioned by. the Foundation 
itself. • ^ 1 — 

What are the agencies in Britain that execute evaluative studies in education 
commissioned by the bodies already mentioned? Undoubtedly, the universities 
take most of the work. There are virtually no non-profit org'anisatipns in 
the field, -grtrch not -or-s±ngiB commereicti compcmy^ "the pa3l?, there have b^en 
some commercial and non-profit Ventures, but there is nobody willing now to 
pay the full cost of* extensive educational evaluation. Table. 3 shows the 
chief agencies that have been re^sponsible for commissioning evaluative studies 
in educa.tion in Bri-taia* LL alaq shows the executing agencies. 



Table 3 British agencies cpmmissioning and executing evaluative 
'studies in education. ^ 



Conmissioning ager\cies 



Executing agencies 



Department of ,E/iuca^ion aVid Science 
Scottish Education Department . 
Central Advisory Councils for Education 
Social Science Research Council 

xVuffield and other foundations 
Schools Council 



Plainly universities 

'Mainly universities 

Universities . 
# 

Universities, polytechnics, 
• LEAs and» NFER' • 

li^yi 1 y-^u n i ve r s i t i e s 

Universities, NFER 



Tfible 4 shows the responsible agency for a short list of Schools Council 
evaluation studies. The list may not be entirely represeijtative, but the 
dominance of juniversities is striking. They are the bases. for many of the 
projects, and their staff dp the evaluation a^ well. 

Table 4 lEooecuting agencies for sora^ British S.cjiools Councrf 
evalua'tive studies. ^ 



Project 



Executing agency* 



Science 5'13 
School Classics ^ 
♦Sixth Form^Mathema-tics 
Integrated Studies a 
Humanities Curriculum. 
Mathematics for the Majority 
English lof Immigrants 
Project Technology 
Secondary Science? 

Bilingual Education in Wales 



University of Bristol 
Cambridge University 
Reading University 
Keele University 
University of East Anglia 
University of Exeter 
Leeds University 
Keele Univers 



, Chelsea College of Science 
and Technology (University 
of London) 

University College, Aberystwyth 



In addition to the universities,^ thdfe is the Natip.nal^ Foundation for 
Educational Research (in EnglancT and Wales') and the Scottish Council for 
Educational. Research • Neither of these is a trust like the Ford Foundation^ 
Tl^eir funding ^omes partly f rom^ the sale of tests and partly from the 
dovernment direct, but they also receive. grants thjrough thje bidding to tKe - 
Social Science Research Council, chiefly to that Council If^^ucfiitionai 
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Research Board. This B:kard operates almost entirely in reacti-re xrxyfe^ 
reconoendmg to tbe Council the ftmdiag of tecssnically soimd ^ropDsals^. ks ^ 
the titles o-f tbe two FaizndatXoiiS and tbe Board indicate, their in^n ooncera* 
is gexteral edttcational research, not sp^ecifically educationtl" evaluation. 
H^ey are far enough - remored froic politics for cost of the evaluative studies 
linked vath their names to have been ftznded for ed?»cators' reasor^s Vatber 
than politicians*. ^ - ' ^ 

The picture of comdssiomng agencxes.fn Ai&erica xs far more cocplex than the 
Entisfa one. As v^e have seen, the furiding of A&erican educational e%-aluatipfl 
IS by authorisation at tbe Congressional or State legislattjre levels; ^the 
political authority exercises detailed control over dej>artm€:atal budgets. 
Once tbe funds "are authorised, the conmssioaing agencie^are the bor^jaucracies 
at Federal arid State le^^els. AERA members do not need t^ be remi n ded tliflt tte . 
pnncip>al Eederal conmssioning agency for ^•^duative stt^es in American 
education is tbe US Office of Education, follo^^dby the Katioxml Institute 
of Education, j'ltiiin the/ former are various hJEPfes, and under the lattAr are 
the Regional Educational i-aboratones and the ^Research ^tnd I>e%*elopcDent Centres* 
The 50 State Offices of Educati'on are ponmdssioning an increasing number of 
evaluations, using funds from Federal and State sources. At the^ local level. 
Boards of Education nov commission evaluative jstuiies, although they u^ally 
collaToorate vith Federal and State evalu^ions. ^ 

In addition to tbe large member of different'' agencies' directly involved i<n 
education and commissioning ei^aiuative studies, ve have to bear' in mind other 
Federal and State departments with an interest in evaluating educational 
programs. Hie Office of Economic Opportunity, for eramiJle, has taken a keen 
interest m educational^ evaluation, particular in programs sucii as tbe Job. 
Corps. Sunilarly, tbe £>epartment of Labour has directed its attebtibn towards 
^inditstnal training ai^ its evaluation. Son^times the Vhije House itself has . - 
>directed that evaluative studies should be cimmissianed. Specialist bodies 
sucia as the National Council for the Education of Disadvantaged cdiildren also 
have had limited funds at their disposal for evaluation. The number of 
evaluative .studies contemplated by Federal commissioning agencies is high, 
as inspection of almost amy issue pf the Commerce &isiness Daily »vill shov: 
add to this ntaaber of those a^ Statfe and Local levels and the picture is one 
of considerable activity. 

Octside the public sector there are private foundations, such as .the Ford*^ 
Foundation, vhich have taken a more acti-^e role in educational evaluation 
tb^ any in Britain (except perhaps the Nuffield Founidation)* Moreover, 
there are professional associations, such as AERA, v^ch foster the 
-development of educational evaluation, if not by commissioning studies then 
by training staff and uiKiertak^ng reviews of the state of the art. 

So much for /the commissioning agencies. The picture of jthe executing agencies 
m America is even more complex. In the past^ tlie universities dominated^ as 
in Britain* Today^ evaluative studies are carried out by universities, non- 
profit research organisations, for-profit companies, XEAs, State Offices of 
Educatipn, and so on. These agencies are in cany cases competing a^inst 
ea<di other in bidding for contracts for evaluations- ^t is quite possible 
that a research com pan y in California Kill obtain a contract from U50E in 

Lngton for an evaluation of Federally -funded projects in a score of 
states spread across the nation. Moreover, there is no^ assurance that the 
same projects will be evaluated J)y the same conpany, funded by USOE, the 
l*6llowing ^ear. Nor is there any assurance that tfte same project will r^ot 
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be tbe- subject of Zwo eraluative stixdi^^ comnussioned 'b>' dlff^r^nx agencies 
Vit. TOaghl^y the same tiiie* * 

l^is brief ^Lnd not very detailed des^crip-tiorj of the conmssionmp axird 
execaiting a-geocies m the two cotsntnes is s-uffioient for us to scart so 
exanarJfetion of the patterns of* forces that are built up, m Britain ar>d 
AiDenca, between the conmussiorurig agencies ^^tenj ^t^e Ciay^^^call the clients - 
%fc'hetber or opt they are'the ultimate clients the evalua^ors and the 
^*aluated. The topic is vatst, bat it Ls worth making a fe** obserrations on 
^^•di f f^rer#ces betveeis the two count rn^s. 

• Itj 3r>tain, 3lrfOe the anoiini^f educational evaluation fas ;defLi5ed m this 
papers is rather lo*», there\^rn^ 'profession* of educational e^'aluation. 
^>oT is ^.here a burea^sicracy at Ventral or regional levels devoting itself zo 
cocEsissionirig evaluation to be earned r»ut b> such professionals. Kor is . 
there a great exp^tation on the part of those m the schools &nd other p^rts 
of the educational systen that formal evaluata*c^n. vill t^e place. I^nere have 
been k fev ^tterrpts to formalise evaluation as a parjadlar branch, of 
'€5iucatior*al endeavour, ror exac^le^ the Social Science Research Cooncil /^nd 
th^ Schools Council have sponsored small-scale seminars < see ,#^cI>oriaI d and 
Valker, 1974)'. Bjt there is no Centre fdr the Study' of E'\-altiation, as there 
IS in Los Aa9eles^ complete vath its ovn journal rnraluation Commegt . It 
IS Hignificatnt tiiat most of the entries m a book to be poblish-ed ir. Eaglaj^d 
and America (Hamilton et al m press) on alternative carncaluu! evaluation 
are m fact American m origin* An earlier book on curricujjom evaluation 
published by the National Foundation for Educational Research fViseman -and 
PidgeOT, 1970), drev heavily on A^gricau toA^ eiidorsing the Tyler approach. 

^^^^^ y >i, 

< \ 

Ifideed, evaluation studies in Britain have been of an almost intimate nature 
(for example, Simons, 1971)* As ve have setn, many of them have been carried 
out by staff attached to the project being eval^ted, therefore .evalua tors 
and evaluated have had to live together * Even the commissioning agencies 
havjB not been far away; fheir officials have in many* cases ta^pen a clos^ and 
personal- interest in both the project and its evaluation* 

, This intimacy is exeo5)lified most clearly in the Open University. The Open 
University contains the commissioning agency, the eval^iated and the 
evaluators, .bound together inextricably* If the Univerpit^* decides it 
vishes to have i't^s courses evaluated, the decision is tfiicen by a committee 
csad^ up of staff, v^io have made the courses and staff vho Kill carry out the 
.evaljiation* • Sometimes the same individuals occupy a double role* In this 
context, the jjotion "31 accountability cuts both ways; the evaluated vtish to 
be seen to be accountable -in terms of the quality of the courses they have 
produced and their willingness to' make sensible modifications, while the 
evaluators wish to be seen to be accotin table in terms .of the quality, 
validity and rutility of the evaltCative studies they underta}de* The course 
oaicers nay depend upon a favourable judgement of merit of their course* in 
order to procure funding for further courses pr a modified version of the 
original course* The evaluators depend upon the c6ul^e makers* votes to 
sustain their activities and isaintain the credibility of ^their image in the 
IMiversity* In such a symbiotic relationship, there toay be some internal 
politicking (as indeffed there is at the Opesy University) but the general aim 
belt) in view is the*good of the institutidn aud its students* Subsidiary 
goals of the evaluated and the evaluators 'are discussed quite openly* 
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In stark ^contrast, the vertices of the American •triangle* of agencies and 
the evaluated are cuch further apart* The a»cdssioning agencies operate 



a notiel founds apc?n M-estJim scientisa, va^b rechsologiciil and conEx>€rciAl 
OTT^rtone^Sm Tbtre are many ur*der lying assuirptiorts, of wtuch only ^cce or 
two cao be ©est x or^ed here* For exanyle, aSsun^rtions are ^ made abc»uj><be 
porssibility of pre-lictiag outconres m eduoatioa: if only the objectives of 
programmes can be specified accurately erough, a:^ ti^e treatment replicat-ed 
precisely, «tb a srtalar st:adent population oiie should be able to obtain 
Similar results • Evaluative steadies are frequently aijned at confirnLrng this 
model, as in tbe Follov Through case qiiote-d earlier. A product ideology 
supporvs tbeise assurrptions * Education is seeii/as an ir idu st-r>*, and 
evaluation as quality control of produces or jkx i^east of processes- Vhere, 
as m coEcpensatoo' e^cation, tbe processets Appear to be tamxng out 
inad^-iate products, attemion is focassed on^^tfe^giog tbe processes. Of 
course, this approach has its critics (suc^ as Hoaser*S-$Z2i_ 1975 K 

arid msmy variations ^see 3onc±i, 1974; Arxdersoa et al . 1975Tr s*i-^5^>eral , 
ho%^ever, the conntissioning ageaciess are uader strocig political pressures, 

have seen, tQ^sb^ that noney being spent on educational programs is 
not being wastesi. Because the pressure is political, they attetcpt to 
depDliticise the e%-aluatiorr process by putting it on a coccDercial ar<d 
apparently objective basis. Contracts for evaluative studies are not avarded 
on a political basis but on criteria related to cost ^Lnd t^<±inicai excel iance 
of th^ proposals received. The mark^ft economy pervades tbe bidding procedures 
as^the 'boiler-plate • of an>' USOZ V*orit Stater&etfit ^sp^ecifying the work to be 
done) shoi^-s. Popt^aa ^975^ bas noted the roushrooiB grovrtb of private ^ 
educational evaluation coirp»Anies vdlling to confonu to these proceduf^ in 
order to tnake laoney. " . ^ * 

In thi>se ci rcumstaLnces , tbe bidding agencies, that is, the evaluators are ^ 
expected to beha%*e like bidders fj^ engineering contracts. They are liot • 
encouraged wO develop tight li^iks %dth the commissioning a^enoies <"althou^ 
soni^ do), for fear of corrupt practices. In turn, the evaluated see the 
concnissioning agencies as sitting m jad^en>ent upon their, through the issuing 
of contracts to the evaluators. Evaluators must be received with respect, 
but it seems advisable not to t'ell then too- much. 

Vitfa the vertices so'far apart, it is not really surprising that tbe 
commissioning agencies find it dii"ficuit to use ^he evaltiation reports, the 
evaluated coisplain that the reports miss the point all too often, and the 
evaluators feel tSey* cannot win* Fortunately for the latter/^ the political 
pressures continue, leading .the commissioning agencies to .issue ©ore 
requests for prop)osal , arid tbe cycle is repeated. Imat is far from obvious . 
is that the repitition of tbe cycles leads to real icproveaent in the 
programs being eraiu^ted. 

This description *bf evaluation in America may be overdrawn, or the British 
scene may have been underdrawn, for that natter. It is significant, 
hovever, that in Britain there lias been a rapid growth of an evaluative 
•style' called illuminative evaliiation, which Is suited to the intimate 
working relationships xhat. prevail there, although its use was first 
described in a study undertaken by Parlett at KIT (see Pari ett and 
Haaailton, 1972). in America, there has been a proliferation of large-scale 
studies at tbe Federal level, even though there has also been an increase' 
in State-spor*sored evaluation. Be|l (1975)^ ^ Connissioner oCl^cation, 
claimed that conscEser activists firxls a natural focal point in education and 
urged educational researchers (including evaluators) to establish a 'more 
productive Velatidnsbip* *fith the consumers, through the coraesissioning 
agencies, of course* It Appears Chat tbe constiaers want restjlts, preJerably 
quantitative ones. Illosinative evaluation would not be enoughf although 
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there' xs some syrcp^thy aBi£>ng Amerac^i er^Llu£l^o^s for siici non-^ucntitati^'e 
approac^s as arrthropo logical field laertods • l^itz and Hfsaxsey, 1974>># ca^ 
studies ^Sffiitb and Keith, ' 1971 ) ♦ aad trarisactional evaluation ^aipper, 1973 
the latter beir#3 coricemed ^ith uncovenng the satisfactions and 
dppreJieiisions of persons iurolred in institutional change. The consux&ers' 
d em a rri s are conveyed to the evalaators by the c o i iiii i i ssioaing agencies, *i50 
prepes^ very nr^ch ni6re detailed Vorii Statemerrts than used to be the case a 
fe%»* years ago, tb^refey constraining the evaluators* a^spnoachers. Khat is 
interesting to r^ote, however, ts that the consumers iri America are not 
nerces&ariiy the evaluated. C/te^a they are outside tJre^psgic tnar^le we 
have been examining, exerting massive pressure or5 ^cb^—ii^rteac occupied by the 
consul SSI omng agencies. Ko v^onier the triangle gets b€ntT"'"^i^iQ vonder so 

many p>apers at A£EA are devoted to responding to this pressure! 

* 0. ^ 

That sounds like an attack iipon America. It is not meant to be one. The 
ban&ling, under- financed approach to educational e-v-aluation m Bntair is 
equally open to attack for those vho «sb to fight back. Vhat this paj>er 
IS trying to illustrate, more or less objectively, are the considerable 
differences between educational evaluation in the tvo countries. Some of 
these can be traced back to different jAxilosophical and ethical standpoints. 

The use made of results of evaluative studies 

Hov are the results of evaluatives studies used in Britain and America? In 
both countries, of course, they are frequently dismissed by those to vliom 
they are unfavourable. That is simply humaui nature. It is simple enough 
to"»find faults in the studies and to declare them invalid. There is a long 
hi s to J^. of such declarations in America; the samples vere not properly dravn, 
there vere no control groups, the tj^ts vere biased, the treatment vcas not 
replicated accurately, the funds wetre inadequate, and so on. Some of these 
disparaging noises are made about ^^luative studies in Britain too, 
regardless whether illuminative evaltxation has .been practised or not. 

The real differences are to be observ^id in following up vhat happens as a 
result of the evaluators' reports. In Bri£ain, the reports are fed into 
policy reviewsji whether at national or regional level, and enrich the debate 
among officials, seldom among politicians. Parliament may have a short ^ 

* debate upon, say, the Bullock Report on reading,, but the changes in policy 
to give effect to its recommendations are more o.ftea than xx)t implemented 
through the bureaudracies. In Ame^pica, as we have already noted, politicians 
actually take note of the reports Jijr summaries of them where the number is 
too large, and use them as political ammunition at all levels to influence 
l^i slat ion and funding. Bducatipnal practice in the classrooms may actualJLy 
be changet^ over a shdrt time^sca^ as a consequ0ice« There is an inherent 
instability in the system, hence an openness to chax^e. In^ Britain, the 
commissioning agencies ponder on th% studies produced by the evaluators, 
consult the evaluated, anid, over a^uch longer tine-scale, move towards new 
policies* 

V ' 

In America, there is an expectation among the coum issioning agencies that 
evaluation reports will 1>e tied directly to policy-making and change* )fthy 
have evaluation if it'is not to influence decision-making? The evaluated 
tolerate the studies becaxise they have to,, and hope to cose well out of thea^ 
^ perhaps .even with additional fundir^. In Britain, the evaluated havje little 
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4 ci^nfidecfce rhat rbe- results ^i2 2 sw^v opinion srd rihr€^ think rJiat orh^r 

factors vill pxr^v€- toor^ inrpo riant m rbe firial a^a^ysis. rbe>' etre not 
obliged ro a^ccepn ^-valuarion i^ inc?st c-a&es, therefore tbeir attitudes 
towards tfoe en*alu£:tors lajs} t*e mar>.-edLl> less s^^Tr^fcat^pt i c th&n thDse of tfceir 
Ai&encan counterparts. 

Tti^fS^ aiffej^^ces can be il 1 astrat-ed hy conrpa^riaj the Unii^ersity of Kid- 
Ansenc^: vith the Open Lirai-ersi ty. Both lasti tut ions are funded ^t tb£ 
natiorfcal level. Evalaation is part of their philo^j^es. At the Umversity 
of Mid-Amenca, bovei-er, there is the atoosphere of au erperiinent. ^Indeed, 
m 1974 President V^rner ^aid of the State Ikiiverslty of Nebraska ^ the fore- 
runner as^sociate ins^it^^tion of the University of Kid^America ) that if 
the Tf^alts ehoved that it v^as r<ot succeedirVg it should be closed dovn. He 
set a tlI^e-«'Cale of fr ver>' fev years m vhich to shov siiocess. Funding 
fr:«r K^Lfhington v^as granted on spjc?^ a basis* 3>- contrast, the Oj>en Urxiversity 
>»><sJB establisT.ed under a riatioTial political xnit:tative and a Hoyal Ctiarter 
^^tti assured it of £ less erp^enirental and precarious existence during its 
infancy^ It v^as ro\ free Trom political attack, as press reports show 
'Havkndge^ 1975b , but it was set up as an institution rather ti^m as an 
expennsent* The l^versity of Kid-Amenca i s ^ j?rfesamabl y still experiiDental , 
%iath evaluation reports flovmg steadily to V^LShingto-n and providing a basis 
for j*^H* ^.^-«-.-^.r. -f.H-tt^ , T T%o Open University carries out self- 

evalutataon to rjrprave its functioning, but receives its funding on the basis 
of overall assessments of the needs of British higher education atjd the 
Gcn'emnjent ' s spending priorilies. It xs not required to provide evaluation 
report's: instead, it "submits bids for fkinds based on plans' for the futtuje 
rather -thstn retrospection* Its continuation is practically guaranteed, 
aithottgh there may be debate aibs^t the level of support and certain aspects 
of the University's de%*el opment ♦ ^ ♦ 

\ 

Similar exarcpl es can be dravTi from curriculum developiment and diffusion 
pxDjects m the tvo countries, as "reported recently -bj* Harding, Kelly and ^ 
Nocodemus '197€.>, althou^ these autiiors point out^tiiai generalisations are 
difficult to formulate in the British case. 

1 ^ Jit 5 

Possible e^'olution of British and American approaches to evaluation 

i • * ' 

Vie no*< enter the realm of pure spjecalatipn, although our speculations ©ay be 
informed by we have observed^ AERA members feel that powerful political 

and economic forces are likelyc\o ^T±n^ about changes in the approaches 
employed, zn educational evaluation in America, >'lf *the progr^ for the 19^6 

• Annual Ki^etxr^.is anything to go. by> Among the political forc^, trenchant 

disaxjvdft^^e^ mi^iority groups are <:x>v^xr^ti^ with aiddle-ciSss people ^ ^ 

.disillusioned with ^cientism in "filing ffcr Less use of achievement t^ts ^ 
and more jattention to affective issues. Vill they win the day? If so, will- 
there be Ian increase in approawi^ftes similar to British illuminative 
evaluatiop7 Of will these approaches be seen as too distant from public . 

- policy decisions to be worthvhiTe? 

AltematiTely, it is just possible that in America values will change so much 
that education will decline in importance. The A£RA session on 'OvCTp- ^ 
education*^ may be tai'ien as an early warning. If capitalism and the rge to. 
increase p^xJuction fall into disrepute, then consumerism iiay also become 
• - • Ipss^ favoured, the current emjrf^asis in America xxpon successful development 

(aJid testing) of educational products - ^e£ng packages or processes' or 
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prograinss but not p>eopIe - ma> c^xan^e as a core hum^s m stic appTOa^ci g&ins 
bold* Viil ti>e dey come viven Amencaxts are viHrng to t r^ s f <=*r to oe-edr 
conncmities large sums of mc?n€0' ^irtoat rwazrjcrg account^ility'' If so, 
sdiall ve see then a svir^^ frozr sunBi;ati%*e to formative ei*aluation? A 
ciiaage fron esrptit^isiTtg xi^^ q'aa2it> of the protl^ct vo eii^^hasisxrig rbe/^crc^d 
social goals to be aciiieved and vcaj-s to help people to get tbere? 

Perhaps ve are descending nov towards oere* rhetoric. After all, -rhe vork 
done by Air^rican educational policy research centres does not yet give as 
a strong basis on ^l^t^cii to project future vr^^djs. On the other hand, this 
A£SU n>eeting features sessions rach ais the ones entitled 'An end of 
affluencei educational eValuatioS ic ti^t iDone>- txmes% and 'Confidentiality 
ojf data versus the right to krov , r^e^ probleins for e^acatiorAal researchers*. 
These indicate the tiio€ts are a -changing. 

* 

What about m Britain? Vhat changes are lakely there? The most ob-vious one 
apj>ear^ to be towards less educational evaluation. It is true that son^e 
bodies are beating the druii of cost— effect i%"eness, sa^irig that m times of 
econoffiic cnsis there should be more e\*alua^^i-On m order to %ce€<i out vthat is 
not effecti%'e and to enhemce *»iiate\*er works. But hardly anj-body is liste5iir*g. 
The shortage of funds in education is likely to become so dan^aging that all 
energies u-ill be de^'oted to keeping Ihe system -liable. Declining birth rates 
are already lesading to closure of &dbools and reductions m the* number of 
readiers being trained. It seems unlikely that this trend vdll be rei*ersed* 
Under such circumstances, educational evaluation of the kind we have been 
discussing looks like a quite luxurious frill to be added to pj^tige 
projects. Even at an institution like the Open University, tough qu€:stions 
are probably going to be asked, like 'Should ve evaluate the existing courses, 
or use the money to add to our relatively s>ender stock of courses?'. Vfaen 
one considers tl^t in British education the vast majority hi staff at all 
levels have tenure, either by virtue of their conditions of service or through 
recent legislation passed by Parliament, the room for mano^wer in hard tuners 
is ctuL down drastically. 

This pessimistic account of the future for educational eval xation in Britain 
should not be taken to mean that there will not be qualitative changes too. 
Illuminativ^'^evaluation, although upon many people's lips^ is* still something 
of an untried approach. A great many hard-line educational^ sociologic2Ll 
atnd psychological researchers who may be associated with etfupational , 
evaluation are not yet convii^ced that illuminative technique^ are replicable, 
leamable^or even useful. They stand by their older oethodsi (Likewise^ 
ethnomethodology is a word *4uch appears in certain journals put. not yet in 
standard dictionaries.) Vill illuminative eval u a tors be around in ten years' 
time? Probably, but not in great numbers in Britain, it seemsi clear. Vili 
other methods be employed? Yes, but again the ojTportunities sVen likely to 
be rather limited. \ 

One thing, seems absolutely certain for British educational evaluatoirs: they 
vill continue \o ga^e ^ross the Atlantic; and to be filled with a mixture 
of adiTT ration J amazement and incx^edxility at what they see happening in 
>Lmerica. Haybe their American counterparts will sosetim€:s feel the sane way, 
if for quite drfferent reasons. 

' ' 18 



€-:^^catic>ria2 evsiv/ftion' concepts ^ss:L ^ ^c^xru gues evaluating 

B&ccock, £.r.. r^^l' Lduc3Xior in t^/^ instfle years: the firs t r^ppi-i 
frjs ine Scfic^ols Ooorxcil Middle >ears of Schyplm? ?Tt?^t > Lor^n: 
Evans Bras.-Methuer.. ' ^ 

5^11, I-H. '1975' r*^catioriil resea5Pi:±i srrd the public interest. ^ 
£j^u c& 1 1 c^nal H.^ea rch e r ^ Vol. No.c. 

Bench, CD. -5-2-' 'I^"^^ £%-&lu3tiDQ e:^ucatio-£&l prc>pr&gis and products . 
L-ioi^v-^'-c '^liff^. J*-.^- ScJ-c^tic-r^i ecrirol eg?* r^iib i i c&ii c^ns . 

Bjtt, S.£. 1-^2 A fea^itiliiy study of PPBS ir Glouce-stershi re . 
^ Local ■Sov-erniiter;t Studies Apnl- 

Cl^irk, D-L. ^I'^^'To' reaeral policy- m educatic^nal researchi ard devel opnier^t . 
Educational Researcher Vol . 5 ^ • ^ • 

Eisner, E-V. 'i975J Tne perceptive e>-e: toward the reformation of 
educatic^nal evaluatic^n. P^per present^ at the Anmal Keeting of the 
American Educational Research Association, VashJ^ngton DC, Karch 3i- 

Fowler, G* a974a) Peels ion -isakiro in British education s>rstems; 

Central QOvemiDent in education %. Milton Ke>-nes : The Open University Press. 

> 

Fovler, G. < 1974b) Decision -making in British educatibn systems: 

The Local E/^ucation Authority . Milton Kej-nes: The Open University Press. 

Fowler, G. U974c ) Dedsion-roaking in British education systems: 
Central government in education 2 . Milton Kej-nes: The Open University 
Press . 

Kalsey, A.H. ' ed . > ^1972) Educational priority: Vol. 1 EPA problems 
axiB policies . lx>ndon: He!- Majesty's Stationery Office. 

Hamilton, D., Jenkiris, D., King C; KacDonalrd, S. and Parlett, M. 

Un press > Whatever happened to Daniel Stuff! ebeaia? a reader in aitemative 

CTrriculup evaluation * London: Kev Press* 

' . Harding, J.M., Kelly, P.J. and Nicod«sus, R.3. (1976) The study of 

ctirriculusi change. Stuijies in Science Educa'tion Vol. 3. 

Hawfid^idge, ^).G, (1970) Designs for evaluative studies. In Evaluative 
research: strategies and methodsl Pittsburgh: Axaerican Institute for 
* Research. 

HaVicridge, D.gI (1975a) Caricatures of educational evaiuators^ 
Privately circulated paper. ' ^ . 

Hawkridge, D {1975b) , rhe Open University: a select bibliography 
Hilton Keynes: The Open University Press. 

ErJc » 19 



•18- 



Hcrose, f 1973 Sc^col ey'alaaticm. rh^ polarics &nd process > 

» in education ^ London : Saut 1 edge aod K^^^am ?&ul • 

Lurz, r.V. and ?^ao:se>', K.A. <19'^4J Tr/<E- use of anthrapDlogicai field 
roette^ds in e<i*i^catzon. S^cati onal ResearcA^r %'ol . 3, So. 10, 



HcZ>aniels, G. ^19/:^> The e-»^aluaxion of roiiov Through, rxzucat lonal 
SLesearcher Vol. ^, Jo. 11. 



KacDonald, B. , Jeokins. D. , Fjanmis, S. ai-id lavT^ey, D. < 1973 / The 
progr&crpe at t»?o: an WCAL evaluatibn report on rhe ?vau>or»aI I>6^elopp^it 
Pr>arcmiae io Coicput er-As si s^ed Leartiinq . Norwich: CeiJtre for Applied 
P-es-earch in EdtJtcation, Uruversitj; of East Anglia. 

Kac£>onaldag. and Vtalker, E. <i974) Ca&e-'St:udy and the socied 
philosoj^y^f educational research^ Paper presenred at a cacmference of^ 
professional evaluators convened by the Schools Council, September 197^^ 

McLaughlin, H.V. ><r975) Evaluation and refom: the Zlemegtar>' and 
Secondary Education Act of 1965, Title I > Cambridge, Mass.: Ballinger. 

Murj^y, J.T. and Cohen, D.K. (1974) Axx^ountability in education - rhe 
Ml ciiii^aca experience. The Public Interest Vol. 36. 

Nuttall, DiL. (1971) The 1968 CSE iponitoring experioent ^ Lbndon: 
Evans Bros. - Methuen. 

.Nuttall, D.L*, Bacicbouse, J.K. a^d Villroott, A.S. (l974) Comparability 
of standards betveen subjects . •Ixmdon: Evans Bros. - Methuen* 

ParlettWM. and Hamilton, D. (1972) Evaluation as illumit^tion: a nev 
approach to the study of j innovatory program^ Edinburgh: Centre for 
Research in the ^Edi^cational Sciences, University of Edinburgh. 

Poi*aa,'V,j, (1975) Educational* evaluation . Englewood Cliffs, N.J. 
Prenti^-Hall, / 

Rippeji P.M. (ed. ) (1^3) Studies in .transactional evaluation . 
Berkeley, Calif.': McCutchan. 

Schoois Council (1973^) Evaluation in cirriculun developaent: .twelve 
case Studies . London: Macs^illan. 

Schools Council ( 1973b)* Patteuj4eL& variation in curriculiin developoent, 
tdth:* reference to sixteen projects sponsored bythe Council and other 
orgahi sa ti ons » London: Schools Council. 

Scrivcn, M. (1967)^ The oethodology of evaluation ^ In StaJce,,R. (ed.) 
Perspectives of curriculua evaluation * A£PA Monograph No. 1. Chicago: 
Rartd HcKally. 



20 



£xiiiC''vs, H. > lnrto\&X2on arai the casc-stiid>'^ of schools. Oi mb ndge 

Jc»ujT>&I of Eaucation. Vol . 3 • * ' 



Sirath, L.M. asrd Keith, ?.H. '19Tif Anatonnr- of e^jcatio innovation. 
Ne^ York: Vile^'. 



Sriace, a.E. '19^3^ Sch>o2 account^ility lavs. £%-3luatyp Comrpent 



Vol. ^, No. 1 



Wiseinar*, £. ard Pidgeon, D. ^1970) c^umculun? erAluatlorf sf Vigdsor Nation 
roimdatior. for E;lucational Researcn. 



'I 



\ 



